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PROCESSING FOR NOISE REDUCTION IN COLOR IMAGE SIGNALS 

Background of the Invention 
1- Field of the Invention 

The present invention relates to a color image processing 
apparatus for executing reading and recording of color image 
signals . 

2. Description of the Related Art 

The construction of the prior art color image processing 
apparatus adapted for use in a color scanner, a color facsimile 
and so on will be described below with reference to Fig, 1. 

As illustrated in Fig. 1, the prior art color image 
processing apparatus is constituted by an input image processing 
circuit A and an output image processing circuit B, 

The input image processing circuit A includes a color image 
sensor 11, A/D converters 12 through 14, and shading correction 
circuits 15 through 17, and executes input processing of three 
color image signals consisting of R(Red), G (Green) and B{Blue) 
color signals. 

The output image processing circuit B includes a color- 
transformation processing circuit 33, and an image format 
transform circuit 34, and executes output processing of the 
three-color image signals outputted from the input image 
processing circuit A. 

The color image sensor 11 is formed by a contact type color 



image sensor (CIS) constituted, e.g.r by either a plurality of 
charge coupled devices (CCD) or a plurality of photoelectric 
conversion devices, arranged one-dimensionally, respectively, 
for three colors, i.e*, the R, G, and B colors (the RGB three 
5 colors) . 

The operation of the color image processing apparatus 
having the above-described construction will be provided 
hereinbelow. 

The color image sensor 11 converts manuscript images into 
13 10 analogue color image signals of the RGB three colors, and outputs 
|U these signals. The respective RGB three-color analogue signals 

outputted from the color image sensor 11 are converted into 
f: corresponding digital multi-level signals by the A/D converters 
12 through 14, Then, the multi-level signals are inputted into 
|;.15 the respective shading correction circuits 15 through 17 so as 
f4 to be subjected to correction of output distortion (shading) in 
the scanning direction of the color image sensor 11, and are 
outputted therefrom as corrected three-color image signals. 
The outputted three-color image signals from the shading 
20 correction circuits 15 through 17 are processed in the 
color-transformation processing circuit 33 to receive a 
gradation correction and a color-coordinates transformation and 
thereafter, the signals are processed by the image-format 
transform circuit 34 to be subjected to a transform processing 
25 by which they are transformed into color image data according 
to a predetermined format such as the bitmap and the JPEG. 
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In the color image processing apparatus, for the purpose 
of achieving speed-up of reading of the color image signals, it 
is necessary to shorten the accumulation time in the color image 
sensor as well as to increase the speed of the transferring clock. 
In this connection, the drive system for the luminous source such 
as the CCD and CIS used for the color image sensor is increased 
in its driving speed owing to the technical advancement of recent 
years , 

Nevertheless, when the luminance of the luminous source 
used for the color image sensor is constant, the amplitudes of 
the RGB three-color image signals might be reduced causing 
deterioration of the S/N ratio. 

In order to prevent the S/N ratio from being deteriorated, 
it might be possible to adopt a method of increasing luminance 
of the luminous source. However, due to the physical property 
of the luminous elements constituting the luminous source, there 
is a limitation in the acquired luminance of the luminous source. 
Although an employment of a plurality of luminous sources to be 
mounted in the color image sensor might enable it to increase 
the luminance, the number of luminous sources that can be mounted 
in the sensor must be restricted from the viewpoint of dimensional 
requirement in constructing the color image processing 
apparatus . 

Therefore, the deteriorated S/N ratio must be restored by 
image processing, in order to achieve the speed-up of the reading 
of color image signals. More specifically, it is necessary to 



implement a process of reducing any noise component contained 
in the color image signal. 

However, if the processing of reducing the noise component 
is complicated prolonging the time necessary for implementing 
the process/ the aimed speed-up of reading of the color image 
signals will be prevented. To this end, there are many requests 
to realize a method of simply and effectively achieving the 
processing of reducing the noise component contained in the color 
image signals. 

As one simple process that is capable of reducing the noise 
component, a process of moving average can be taken up, in which 
with respect to any notable pixel, a process of averaging is first 
executed by referring to specified numbers of pixels around the 
notable pixel, and then, the process of averaging is sequentially 
moved to a neighboring pixel. 

The above-described moving average processing can exhibit 
an excellent effect for the noise reduction by somewhat 
increasing the number of referred pixels. However, to the 
contrary, when the number of referred pixels (the reference 
pixels) is increased, such a problem is encountered that 
resolution is degraded to produce a blurred image as a whole. 

As a noise reduction method applicable not to color image 
signals but bi-level image signals (monochrome image signals) , 
for example, Japanese Patent Laid-open Publication No . 37074/97 
discloses a method of removing pixels in a region, which is judged 
as belonging to a character component, from subjecting such 



pixels to the moving average processing. 

According to this disclosed method^ with respect to a 
bi-level image, it is possible to remove moire contained in the 
image data without degrading the resolution as well as to 
5 effectively remove noise components. 

Nevertheless, if the method disclosed in the above- 
identified Patent Publication is directly applied to color image 
signals, a smooth change in gradation of each color in the color 
image is averaged while causing a possibility of degrading the 
QlO gradation of the color image, 

I 

^■f Summary of the Invention 

I- 

f; An object of the present invention is to provide a color 

image processing apparatus capable of effectively eliminating 

in 

■ any noise components contained in color image signals without 
pi losing or deteriorating resolution and gradation property. 

In the present invention, with respect to any notable pixel 
i, reference pixels j containing n pixels located before and after 
the notable pixel are selected on the basis of moving-averaged 
20 number n of pixels calculated by a predetermined numerical 
formula, an absolute value of a difference between an output level 
of each of the selected reference pixels j and an output level 
of the notable pixel i is then calculated, and only any reference 
pixel j of which the absolute value of the difference between 
25 its output level and the output level of the notable pixel i is 
smaller than a threshold value is permitted to join a 
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moving-average processing. 

Thus, the reference pixels j of which the output level 
changes from that of the notable pixel i by a value equal to or 
larger than the threshold value are omitted from being subjected 
5 to the moving-average processing^, and accordingly noise 

components can be effectively eliminated without deteriorating 
the resolution of any characters^ ruled lines and the* like. 

Further, after the calculation of a difference I^T between 
the output level of the notable pixel i and that of a neighboring 
0 10 pixel adjoining said notable pixel i, if the number n of 
W moving-averaged pixels is calculated by the following formula, 
iy i.e., 

J;; n = A/ (Ft + B) , where A and B are a constant, respectively, 

in the case where the above-mentioned Ft is small, i.e., where 

Sl5 a change in gradation between neighboring pixels is small, the 

10 

P~ number n of the moving-averaged pixels is large. Therefore, the 
moving-average processing is executed over a broad range. 
However, even when the change in gradation between the 
neighboring pixels is small, if the gradation smoothly changes 

20 so as to increase or decrease by a value equal to or larger than 
the threshold value, the reference pixels j in this region are 
removed from those that are subjected to the moving-average 
processing. Thus, the number of reference pixels used for the 
moving-average processing is reduced. Consequently, any noise 

25 components contained in the color image signals can be 
effectively eliminated without degrading the change in 
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gradation. 

The above and other objects, features, and advantages of 
the present invention will become apparent from the following 
description with reference to the accompanying drawings which 
illustrate examples of the present invention. 

Brief Description of the Drawings 

Fig, 1 is a block diagram of a color image processing 
apparatus according to the prior art; 

Fig, 2 is a block diagram illustrating a color image 
processing apparatus according to a first embodiment of the 
present invention; 

Fig, 3 is a block diagram illustrating a color image 
processing apparatus according to a second embodiment of the 
present invention; 

Fig. 4 is a block diagram illustrating a color image 
processing apparatus according to a third embodiment of the 
present invention; and. 

Fig. 5 is a diagrammatic view explaining the advantageous 
effects acquired by the color image processing apparatus 
according to the present invention. 

Description of the Preferred Embodiments 
1st Embodiment: 

As illustrated in Fig. 2, the color image processing 
apparatus of the present embodiment is different from the prior 



art apparatus of Fig. 1 in that a noise elimination circuit C 
is provided, which outputs the RGB three-color image signals to 
the output image processing circuit B after eliminating noise 
components contained in the three-color image signals outputted 
5 from the input image processing circuit A, At this stage^ it 
should be noted that, in Fig. 2, the same or like parts as those 
of Fig. 1 are designated by the same reference numerals and the 
explanations thereof are omitted. 

The noise elimination circuit C includes, for the 
QIO processing of the respective RGB three-color image signals, 

ifl operation circuits A 18 through 20 which serve as first operation 

fIJ 

W means, bit selection circuits 21 through 23, difference circuits 

f\ 24 through 26, decision circuits 27 through 29, and operation 

%^ circuits B 30 through 32 which serve as second operation means, 

m 

j;;i5 Further, the noise elimination circuit C is provided with a line 
ft memory 35 which serves as memory means, and threshold value 

I, A. 

^ storage memory 36 which serves as threshold value storage means. 

The description of the operation of the color image 
processing apparatus having the above-described construction 

20 will be provided hereinbelow. Although the description of the 
operation given below is notably directed to the processing of 
the G signal for simplicity' s sake, it is to be noted that similar 
processing is in parallel executed with reference to each of the 
R and B signals, 

25 The G image signals that are analogue color signals 

outputted from the color image sensor 11 are converted to digital 
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signals by the A/D converter (G) 13, and are then corrected in 
their output distortion in the scanning direction of the color 
image sensor 11 by the shading correction circuit (G) 16 before 
they are outputted therefrom. 

Subsequently, the G image signals outputted from the 
shading correction circuit (G) 16 is stored by the line memory 
35 in each one line (total number of pixels = N, where^ N is a 
natural number) of the latter memory. 

Then, the G signals stored in its each one line of the line 
memory 35 is read out in order from the top pixel thereof by the 
operation circuit A (G) 19. 

The operation circuit A (G) 19 carries out calculation of 
a difference Ft between the output level of any notable pixel 
i for l^i^N, where- i is a natural number, that is the i th pixel 
from the top pixel and the output level of any one of the 
neighboring pixels i+1 or i-1. 

Subsequently, the operation circuit A (G) 19 calculates 
moving-average number n of pixels, where n is a natural number, 
with reference to the notable pixel i by the following formula, 
i.e., 

N = A/ (Ft + B) 

where A and B are a constant, respectively. 

When i=l, the operation circuit A (G) 19 uses the neighbor 
i+1 as the neighboring pixel adjoining the notable pixel i . Also, 
when i = N, the circuit A (G) 19 uses the neighbor i-1 as the 
neighboring pixel adjoining the notable pixel i. 
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Further, as a result of the calculation of the moving- 
average number n of pixels, if n is not a natural number due to 
generation of any fraction, the operation circuit A (G) 19 omits 
the fraction to make the number n a natural number. 
5 The bit selection circuit (G) 22 selects the notable pixel 

i and the reference pixels j for 1-n^ j ^ 1+n, where j is a natural 
number, that are n pixels respectively located before and after 
said notable pixel i from all of the G image signals in each one 
line, which are read into the operation circuit A (G) 19, on the 
1310 basis of the moving average number n of pixels calculated by the 
operation circuit A (G) 19, and the bit selection circuit (G) 
22 outputs therefrom these selected notable and reference pixels 

f^ Next, when the notable pixel i and the reference pixels j 

^15 are outputted from the bit selection circuit (G) 22, the 

Q difference circuit (G) 25 calculates an absolute value |vi-Vj | 
of a difference between the output level Vi of the notable pixel 
i and each of the respective output levels Vj of the reference 
pixels j, and outputs therefrom the respective absolute values. 
20 Subsequently, the decision circuit (G) 28 compares the 

above absolute value |vi-Vj | outputted from the difference 
circuit (G) 25 with a specified threshold value Th stored in the 
threshold storage memory 36, so as to output the output signal 

of the reference pixels j when |vi-Vj|<Th, and prevents the 
25 output signal of the reference pixels j from being outputted when 
|vi-Vj|^Th. At this time, the decision circuit (G) 28 outputs 
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the output signal of the notable pixel i regardless of the fact 
as to whether or not the output signal of the reference pixel 
j is outputted. 

The above-described processes of the respective circuits 
are repeated with regard to each of the reference pixels j when 
j takes each of (i-n) through (i+n) * It is to be noted that the 
bit selection circuit (G) 22 does not output the reference pixels 
j when the range of the reference pixels j comes out of the range 
l^j^N, 

The operation circuit B (G) 31 executes an operation to apply 
a moving-average processing to the output signal of the notable 
pixel i outputted from the decision circuit (G) 28 by using the 
output signal of the reference pixels j • Thus, the output signal 
of the notable pixel i can be smoothed before it is outputted 
from the circuit B (G) 31, 

The foregoing process is repeated with reference to the 
pixel i when i takes each of 1 through N. 

In accordance with the afore-described processes, the 
smoothed G image signals of any one line are outputted toward 
the output image processing circuit B, and thereafter, the 
smoothed G image signals of every one line are sequentially 
outputted toward the output image processing circuit B. 

Since the above-described processes are similarly executed 
with regard to the R and B signals, the smoothed R and B image 
signals of every one line are sequentially outputted toward the 
output image processing circuit B. 
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The RGB three-color image signals smoothed by the noise 
elimination circuit C are subjected to the processes of gradation 
correction and color-coordinate transformation by the color- 
transform processing circuit 33, and then -the RGB three-color 
image signals are transformed into preselected image format by 
the image format transform circuit 34 and are thereafter 
outputted therefrom. 

In the construction of the above-described embodiment, the 
calculation of the moving-average number n of pixels is executed 
by using the difference t^T between the output level of the notable 
pixel i and that of the neighboring pixels i+l or i - 1, the present 
invention is not intended to limit to this construction, and may 
alternatively adopt a construction below, to execute the 
calculation of the moving-average number n of pixels. 

For example, in the case where i^N-2, an average value [ 
Ta of differences between the output level of the notable pixel 
i and each of the output levels of the plural neighboring pixels 

i+1 through the neighboring pixel i+k for 2^k^N-l, where k is 
a natural number, is calculated, and the obtained average value 
I'Ta may be used to calculate the moving average number n of pixels 
by the following formula, i.e., 
n = A / (I^Ta + B) 

where A and B are a constant, respectively* 

Also, in the case where i^3, an average value i^Ta of 
differences between the output level of the notable pixel i and 
each of the output levels of the plural neighboring pixels i-1 
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through the neighboring pixel i-k for 2^k^i-l, where k is a 
natural number, is calculated, and the obtained average value 

I^Ta may be used to calculate the moving average number n of pixels 
by the following formula, i.e., 

n = A / (fTa + B) 

where A and B are a constant, respectively, 
2nd Embodiment : 

As shown in Fig. 3, the color image processing apparatus 
of the present embodiment is different from the color image 
processing apparatus of Fig* 2 in that only the G and R two- 
color image signals are subjected to the noise elimination 
process in the noise elimination circuit C. At this stage, in 
Fig. 3, the same or like parts as those of the color image 
processing apparatus of Fig. 2 are designated by the same 
reference numerals, and the explanation thereof are omitted. 

With regard to the B signals, even if any noise component 
is contained therein, such noise component of the B signals can 
be considered as having generally a small adverse affect on the 
image compared with the other R and G signals. 

Therefore, in the present embodiment, with respect to the 
B signals containing a noise component having an appreciably 
small adverse affect on the image, no noise elimination process 
is executed to thereby simplify the construction of the noise 
elimination circuit as well as to increase a processing speed 
of the noise elimination process executed therein. Thus, the B 
signals are directly inputted into the output image processing 
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circuit B when they are outputted from the input image processing 

circuit A. 

3rd Embodiment: 

As illustrated in Fig, 4, the color image processing 

apparatus of the present embodiment is different from the color 

image processing apparatus of Fig. 2 in that only the G image 
signals are subjected to the noise elimination process in the 
noise elimination circuit Further, in Fig. 4, the same or like 
parts as those of the color image processing apparatus of Fig. 
2 are designated by the same reference numerals, and the 
explanation thereof are omitted. 

Since the G signals have large brightness compared with 
those of the R and B signals, if any noise component is contained 
in the G signals, such noise component greatly affects on the 
image . 

Therefore, in the present embodiment, only the G signals 
containing therein noise component having a great affect on the 
image are subjected to the noise elimination process. Thus, it 
should be understood that the circuit construction of the present 
embodiment is further simplified while increasing the processing 
speed of the noise elimination process. With regard to the R and 
B signals, they are not subjected to the noise elimination process 
and are directly inputted into the output image processing 
circuit B when they are outputted from the input image processing 
circuit A. 

The advantageous effects exhibited by the color image 
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processing apparatus of the present invention will be described 
hereinbelow with reference to Fig. 5. 

In Fig, 5, there are shown image data A containing therein 
noise component, image data B obtained by applying simply the 
prior art moving average process to the image data A, and image 
data C obtained by applying the moving average process, due to 
the employment of the color image processing apparatus according 
to the present invention, to the image data A, 

In Fig, 5, the abscissa indicates the position of the pixels 
in the scanning direction of the color image sensor, and the 
ordinate indicates the output level of each signal at each 
position of a pixel. 

With regard to the image data A, between the 6th and 7th 
pixels, the output level is abruptly lowered by an amount equal 
to or larger than the amount of the threshold Th, and between 
the 14th and 17th pixels, the output level smoothly changes while 
gradually increasing by an amount equal to or larger than that 
of the threshold Th, 

With regard to the image data B obtained by simply applying 
the moving average process to the image data A, the noise 
component contained in the image data A is reduced. However, the 
inclination of the output level changing abruptly between the 
6th and 7th pixels is smaller than that of the image data A, and 
accordingly it can be understood that the resolution of the image 
in this region is deteriorated. Also, the smooth change in the 
output level between the 14th through 17th pixels indicates loss 
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of a change in the gradation of the image. 

In the present invention^ an absolute value of a difference 
between the output levels of the notable pixel i and the reference 
pixels j is calculated, and only some of the reference pixels 
j of which the output level has such a difference against the 
output level of the notable pixel i that the absolute value 
thereof is smaller than the threshold value Th are joined to the 
process executing the moving average processing. Thus, the 
remaining reference pixels j of which the output level has such 
a difference against the output level of the notable pixel i that 
the absolute value thereof is equal to or larger than the 
threshold value Th are omitted from the process executing the 
moving average processing. 

Accordingly, with regard to the image data C obtained by 
applying, to the image data A, the moving average processing 
executed by the color image processing apparatus according to 
the present invention, an abrupt change in the output level occurs 
between the 6th and 7th pixels by an amount equal to or larger 
than the threshold value Th, and therefore the region of pixels 
is omitted from being subjected to the moving average process. 
Thus, resolution of the image does not deteriorate. 

Further, after the calculation of the difference hT of the 
output level between the notable pixel i and a neighboring pixel 
adjoining the notable pixel i, when the moving average number 
n of pixels is calculated by the following formula, i.e., 
N = A/ (hT + B) , 



16 



where A and B are a constant, respectively, if the 
above-mentioned difference is small, namely, a change in the 
gradation between the neighboring pixels is small, the moving 
average number n of pixels becomes large, and accordingly the 
moving average processing is executed over a broad range of the 
pixels. However, in the case where the change in gradation is 
smooth while increasing by an amount equal to or larger than the 
threshold value Th as is indicated from the 14th through 17th 
pixels, this region of pixels is omitted from being subjected 
to the moving average processing. Thus, the number of pixels used 
for executing the moving average processing is small to thereby 
prevent the change in gradation from being degraded. 

While preferred embodiments of the present invention have 
been described using specific terms, such description is for 
illustrative purposes only, and it is to be understood that 
changes and variations may be made without departing from the 
spirit or scope of the following claims. 
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